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I .  GENERAL 


As  detailed  in  the  report  which  follows.  Task  1  and  2  of 
Contract  #N00173-80-C-0014  have  been  completed.  In  addition, 
the  appropriate  activities  and  reports  pursuant  to  Task  3  and 
4  have  been  accomplished. 

II.  TASK  ACCOMPLISHMENTS 


A.  Background 

The  Critical  Technology  questionnaires  were  originally 
designed  by  NAVMAT  with  the  intention  of  distribution  and  comple 
tion  by  the  System  Commands  in  the  Navy  for  the  examination  and 
identification  of  critical  and  possibly  critical  technologies. 
The  questionnaires  were  distributed  by  NAVMAT  in  July  and  August 
of  1979  among  thirty  pilot  test  participants  from  NAVELEX.  Grea 
effort  was  entailed  in  order  to  obtain  a  100%  response  rate. 

This  was  eventually  achieved  and  the  questionnaire  data  was 
machine  processed  by  NARDAC  and  a  computer  base  was  established. 
The  pilot  data  was  computer  analyzed  by  the  use  of  a  model  devel 
oped  by  Mr.  Les  Winslow,  Critical  Technology  Assessment  (CTA) 
Office,  Naval  Research  Laboratory,  as  a  means  of  establishing 
the  "need",  "can"  and  "how"  to  control  assessments  for  critical 
technologies.  Key  output  was,  therefore,  the  assignment  of  a 
score  for  "naed",  "can"  and  "how"  to  control  technical  data, 
keystone  equipment  and  end  products  according  to  responses  on 
the  pilot  questionnaires.  According  to  contractual  requirements 
essentially  the  same  mode  of  analysis  was  to  be  implemented  for 
the  data  resulting  from  the  actual  survey  and,  as  such,  the  sub¬ 
stance  of  the  questions,  and  quantification  of  response  categori 
were  to  remain  essentially  intact  during  questionnaire  revision 
by  Data  Solutions. 
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B.  Critical  Technology  Questionnaires 

Data  Solutions  was  contracted  to  assess  and  increase 
the  potential  validity  and  reliability  of  the  pilot  test  ques¬ 
tionnaires  (Exhibits  A)  and  to  incorporate  other  improvements 
in  both  the  questionnaire  and  administration  technique  to  in¬ 
crease  the  response  rate  and  facilitate  machine  processing  of 
questionnaire  data. 

1.  Pilot  Test 

In  order  to  assess  the  validity  and  reliability 
of  the  questionnaire  .data,  it  was  essential  to  review  the  pilot 
test  conducted  by  the  CTA  Office.  Whereas  the  CTA  Office  took 
care  to  brief  pilot  respondents  subsequent  to  administration, 
and  solicit  their  feedback,  systematically  obtained  information 
was  lacking  concerning  respondents  reactions /criticisms  of  the 
survey  instruments  (e.g.,  item  utility,  instruction  clarity, 
ease  of  response  time  to  complete,  etc.)  or  the  administration 
technique . 


In  mid-December,  Data  Solutions  undertook  the 
task  of  re-tracing  the  pilot  test,  its  methodology,  participants 
and  data  processing.  This  involved  visits  and  interviews  with 
pilot  test  participants  at  NAVELEX.  A  meeting  with  Mr.  Tony 
Slaga,  Head,  International  Program  Office,  NAVELEX,  (December  11 
1979)  uncovered  the  following  information  about  the  pilot  test 
administration  at  NAVELEX: 

•  The  selection  for  participation  in  the  pilot 
was  based  on  criterion  of  knowledgeability. 
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•  An  average  of  five  people  made  recommenda- 
tions  of  people  at  the  systems  level  of 
technology . 

•  Knowledgeability  criterion  led  to  the 
selection  of  project  engineers  with  a 
number  of  years  of  experience  which 
equipped  individuals  with  knowledge  of 
past  and  present  policies  in  regard  to  a 
particular  technology  area. 

•  Mr.  Slaga  suggested  that  the  individual 
responsible  for  farming  out  case-by-case 
inquiries  (in  the  case  of  NAVELEX  -  Mrs. 
Haden)  would  be  most  able  to  identify  such 
individuals. 

Following  the  NAVELEX  meeting.  Data  Solutions 
consultants  held  meetings  with  four (4)  pilot  test  participants 
In  order  to  optimize  feedback  about  the  questionnaires,  the 
questionnaires  were  revised  so  that  interviewees  were  asked 
for  reactions  to  both  the  original  questionnaires  and  the 
revised  questionnaires.  Furthermore,  revised  questionnaires 
were  distributed  during  a  briefing  of  the  Critical  Technology 
Assessment  on  January  4,  1980  including  interested  officials 
from  NAVMAT,  NRL,  and  ONR. 

Pilot  test  interviewees  reported  problems  with 
questionnaire  terminology  such  as  "critical  technology"  and 
" subdivisions" .  In  addition,  interviewees  reported  that  they 
simply  did  not  know  for  certain  the  answer  to  some  questions 
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such  as  the  extent  of  military  lead  of  the  U.S.  over  other 
nations  or  visa  versa  in  relation  to  their  specific  technology. 
In  these  cases  the  participants  often  reported  a  "don't  know" 
response^  or  simply  left  the  question  blank.  Other  problems 
were  reported  with  instructions  and  background  information. 

A  final,  and  crucial,  aspect  of  pilot  testing 
concerned  the  validation  of  the  mathematical  model  employed  to 
analyze  the  questionnaire  data.  The  model,  as  presented  in 
"Computer  Analysis  for  Interim  Policy  Formulation  of  Export 
Control  Policies",  was  designed  by  Mr.  Les  Winslow,  the  COTR. 

It  provides,  in  general,  a  hierarchical  weighting  formulation 
which  results  in  an  assessment  of  the  necessity,  feasibility, 
and  method  of  export  control  for  each  Navy  system,  subsystem, 
and  device  for  which  a  data  questionnaire  is  completed.  After 
the  pilot  test  had  been  completed  (N=30)  at  NAVELEX,  the  COTR 
requested  that  three  Navy  technical  experts  with  broad  areas  of 
cognizance  and  unquestioned  knowledgeability  individually  assess 
the  criticality  of  each  Navy  system  included  in  the  pilot  test. 
This  provided  Data  Solutions  consultants  with  an  opportunity  to 
assess  the  convergent  validity  of  the  data  analysis  technique, 
by  computing  the  correlation  of  the  experts  responses  with  the 
correspondent  data  analysis  results.  The  mean  correlation  of 
the  three  expert  judges'  independent  assessment  of  technical 
criticality  with  the  assessment  of  the  computer  analysis  was 
rxy=.52,  which  is  a  significant  positive  correlation  at  p<.01 
level  of  confidence.  In  sum,  these  findings  conveyed  significan 
support  both  to  the  validity  of  the  mathematical  model  employed 
in  the  data  analysis  and  the  adequacy  of  computer  analysis  by 
which  it  was  implemented. 
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2.  Major  Questionnaire  Revisions 

The  following  modifications  were  made  to  reduce  ambi¬ 
guity  and  thereby  to  encourage  completion  and  increase  the 
reliability  and  validity  of  responses: 

•  question  and  response  category  wordings 
were  clarified  and  made  more  direct. 

•  instructions  were  clarified  and  added  where 
necessary. 

•  definitions  were  included  for  significant 
or  ambiguous  survey  terminology. 

Two  revisions  were  made  to  prepare  questionnaire  data 
immediately  for  machine  processing  and  thereby  greatly  reduce 
manual  preparation: 

•  response  codes  were  included  on  the  questionnaire 
and  respondents  instructed  to  circle  appropriate 
response  codes  to  indicate  their  response  per 
question. 

•  columns  were  included  on  the  questionnaires  by 
each  question  to  indicate  to  keypunchers  in 
which  column  to  punch  each  response  and  the 
associated  column  number  per  response,  thereby 
incorporating  keypunch  instructions  directly  on 
the  questionnaire. 
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At  the  same  time  this  reduces  edit  and  keypunch 
error.  However,  questionnaires  will  still  be  checked  to  be 
certain  that  response  codes,  not  the  response,  are  circled 
before  going  to  keypunching.  This  will  reduce  both  effort  and 
time  expenditure. 

For  questions  11,  20,  22,  and  26  on  the  pilot  Data 
Questionnaire,  the  response  scales  were  modified  to  render  them 
more  sensitive  while  maintaining  the  integrity  of  the  computer 
analysis.  Specifically,  a  number  of  questions  requiring  highl  / 
subjective  judgments  had  three  point  response  scales:  "yes", 

"no",  and  "don’t  know".  Such  a  scale  has  low  sensitivity  be¬ 
cause,  short  of  being  absolutely  certain,  the  respondent  will 
be  inclined  to  respond  "don’t  know".  Thus,  for  four  (4) 
questions  in  this  category,  response  scales  were  modified  such 
that  respondents  are  asked  to  indicate  their  level  of  certainty 
concerning  the  item  stem  on  a  five  point  scale.  For  example, 
instead  of  "yes",  "no",  or  "don't  know"  response  to  a  question 
whose  stem  requires  a  judgment  of  U.S.  technological  superiority, 
the  following  response  scale  was  substituted: 

confident  U.S.  confident  U.S. 

does  not  does 

1 . 2 . 3  .  ....  4 . 5 

In  sum,  by  requiring  a  judgment  of  confidence,  re¬ 
sponses  at  the  2  or  4  level  provide  for  the  equivalent  of  a 
"probably  no"  and  "probably  yes"  response,  respectively. 

To  clarify  the  questionnaire  instruction,  the  follow¬ 
ing  revisions  were  made: 


t 
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m  Instructions  for  specific  or  following  specific 

questions  or,  following  a  part  of  the  questionnaire, 
were  included  where  they  occurred  rather  than  on 
the  front  page  as  originally  designed. 

4 

i 

•  Instructions  were  outlined  in  blocks  so  as  to 
stand  out  from  the  rest  of  the  questionnaire  and 
make  it  less  likely  for  respondents  to  skip 
instructions. 

•  Formating:  the  questionnaires  were  color  coded 
and  instructions  referred  to  colors  facilitate 
instructions  and  ease  of  response.  The  System 
Identity  Questionnaire,  Part  I  was  printed  in 
yellow,  the  System  Identity  Questionnaire,  Part  II 
was  printed  in  green,  and  the  Data  Questionnaire 
was  printed  in  blue. 

Additional  Revisions 

a.  Systems  Identity  Questionnaire,  Part  I 

•  We  made  an  addition  to  Q1  *or  respondents  to 
indicate  which  level  they  are  responding.  This 
will  facilitate  data  processing  and  keep  clear 
the  level  of  the  response  both  to  individuals 
completing  the  questionnaires  and  those  involved 
in  processing  questionnaire  data. 

b.  Data  Questionnaire 

•  Question  1:  "Does  this  technology  make  a 
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significant  contribution  to  the  performance 
of  a  Navy  system,  its  subsystem  or  devices?" 
This  question  was  omitted  from  the  revised 
questionnaire  because  all  but  one  of  the 
pilot  respondents  responded  "yes"  to  this 
question.  Since  it  carried  very  little 
variability,  it  has  low  utility. 

Column  widths  for  Q14  and  Q15*  were  origin¬ 
ally  two  each.  We  changed  the  column  widths 
for  both  questions  to  one,  thereby  eliminating 
the  necessity  of  punching  "Y"  for  one  category 
and_  "N"  for  the  other  for  both  questions. 
Instead  the  responses  will  be  keypunched  either 
as  a  "A"  or  a  "B"  per  question  with  the  conside 
ation  of  a  "C"  category,  which  would  represents 
"equally  military. . .and  commercial...",  if  this 
is  possible. 


The  intention  here  is  to  encourage  the  respon¬ 
dent  to  select  "A"  or  "B"  as  a  single  response. 
Originally  the  design  of  response  category  was 
more  conducive  to  a  multiple  response. 

•  Q19  and  Q20**  will  be  used  as  logic  checks  to 

indicate  whether  questionnaires  should  have 
been  completed  at  the  subsystem  and/or  device 
level  of  a  given  system. 


Questions  15  and  16,  respectively,  on  the  pilot  questionnaire. 
Questions  20  and  21,  respectively,  on  the  pilot  questionnaire. 
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•  Clarified  instructions  for  Q22  and  Q23* 
where  respondents  are  asked  to  rate  5  items 
with  the  sum  *=  10,  to  ensure  consistency 

of  response. 

•  A  "yes"  response  for  both  Q19  and  Q20** 
would  indicate  that  there  are  embedded  tech¬ 
nologies  for  which  questionnaires  should  be 
completed. 

4.  Questionnaire  Printing 

Questionnaires  were  finalized  and  ready  for  type  setting 
by  the  first  of  January,  1980.  On  January  2,  the  final  revision 
of  the  questionnaires  was  sent  to  Gumpert  Printing  for  type  set 
ting.  The  questionnaires  went  back  and  forth  a  few  times  betwee 
Data  Solutions  and  Gumpert  before  Data  Solutions  was  satisfied. 

Questionnaires  were  to  be  printed  from  the  blue  lines  at 
the  Navy,  developed  by  Gumpert  Printing.  On  January  11,  ques¬ 
tionnaire  blue  lines  were  presented  to  the  Navy  for  copying.  Th 
Navy  Research  Lab  could  not  handle  the  request  for  5,000  copies, 
so  a  contractor  at  the  Navy  Yard  was  enlisted  to  do  the  copying. 
The  questionnaires  were  copied  onto  8*s  by  11,  on  front  and  back 
sides  of  the  paper,  and  stapled  3  tiroes  on  the  side,  as  follows: 


white  paper  - 


yellow  paper  - 


for  front  page  of  questionnaire, 
instructions  and  the  last  page, 
for  Systems  Identity  Questionnaire, 
Part  I. 


*  Questions  23  and  24,  respectively,  on  pilot  questionnaire. 
**  Questions  20  and  21,  respectively,  on  pilot  questionnaire. 
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green  paper  -  for  Systems  Identity  Questionnaire, 

Part  II. 

blue  paper  -  for  Data  Questionnaire. 

~  By  January  18,  all  5,000  copies  of  survey  booklet  had 
been  produced.  The  questionnaires  were  delivered  to  the  CTA 
Office,  Naval  REsearch  Laboratory. 
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III.  SURVEY  ADMINISTRATION 


A.  Overview 

The~Critical  Technology  Transfer  Assessment  Survey  has 
been  designed  to  collect  information  about  the  criticality  of 
technology  or  hardware  for  three  levels  of  detail  for  any  given 
system:  the  system  level,  the  subsystem  level  and  the  device 
level.  However,  it  is  entirely  possible  that  some  respondents 
at  the  system  level  will  not  feel  that  there  are  subsystems 
within  their  system  which  should  be  examined  for  export  control 
and  the  same  for  the  subsystem  respondents  in  regard  to  the 
device  level. 

The  respondent  at  each  level  will  identify  the  subdivisions 
for  his  equipment  and  the  associated  individuals  to  respond  to 
the  same  questionnaire  at  the  next  lower  level,  etc.  This  means 
that  the  survey  is  essentially  a  three  cycle  survey.  (See 
Figure  1  for  flow  chart  of  survey  administration) .  This  cycle 
will  take  place  at  each  system  command:  NAVSEA,  NAVELEX,  NAVAIR 
and  NAVMAT  with  each  cycle  beginning  with  the  system  level  and 
ending  at  the  device  level. 

B.  identification  of  Survey  Population 

The  systems  level  population  will  be  identified  from  a  list 
of  systems  developed  by  NAVMAT  (Exhibit  C)  in  addition  to  those 
identified  by  the  point  of  contact  for  each  command.  In  most 
cases  the  questionnaires  will  be  routed  to  the  head  office  for 
each  system,  at  which  point  the  roost  knowledgeable  person  for 
each  system  will  be  designated  to  complete  a  survey  booklet. 
Originally,  Data  Solutions  intention  was  to  identify  an  indi¬ 
vidual  associated  with  each  system  so  that  tight  control  of 
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field  operations  could  be  maintained.  However,  Mrs.  Katherine 
Weick  at  NAVSEA  strongly  suggested  that  routing  to  head  offices 
for  each  system  is  the  most  appropriate  and  expedient  procedure 
to  follow,  since  the  individual  completing  a  survey  booklet  will 
be  designated  directly  by  a  closely  associated  superior. 

C.  Survey  Packets 

Each  survey  packet  will  be  compiled  as  follows: 

1.  one  route  sheet  completed  and  addressed  (Exhibit  D) . 

2.  route  sheet  stapled  to  an  envelope. 

3.  inside  the  envelope  -  one  letter  (see  below)  from 
the  systems  commander,  and  one  questionnaire. 

The  original  intention  was  that  a  survey  letter  from 
Admiral  Whittle  would  accompany  the  questionnaires  so  as  to 
greatly  facilitate  response.  This  did  not  take  place.  Instead, 
a  letter  (Exhibit  E)  was  created  and  signed  by  Edward  J.  Otth, 
Chief  Deputy  Navy  Material  (Acquisition) .  This  letter  was  sent 
on  February  1,  to  the  commander  of  each  system  command.  The 
commander  at  each  system  command  would  then  designate  appropri¬ 
ate  individuals  within  their  command  to  be  the  point  of  contact 
for  the  survey  administration  at  their  command.  Each  point  of 
contact  will  decide  whether  they  will  refer  to  the  Otth  letter 
on  the  route  sheets,  or  send  a  letter  from  their  own  office. 
NAVSEA  chose  to  include  the  Otth  letter,  whereas  NAVELEX 
included  a  letter  from  their  office  (Exhibit  F) ,  drafted  by 
Data  Solutions. 

In  order  to  handle  the  field  operations  in  Crystal  City, 
Data  Solutions  hired  a  part-time  employee  to  administer  survey 
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procedures.  The  Data  Solutions  Field  Operator  went  to  NAVSEA 
following  the  initial  meeting  and  completed  our  list  of  systems 
level  respondents  by  consulting  with  Mrs.  Weick  to  ensure  that 
proper  organization  codes  were  associated  with  the  systems  on 
our  list,  and  to  resolve  ambiguities  about  cognizance.  Our 
final  list  included  365  systems  at  NAVSEA. 

In  addition  to  completing  a  route  sheet  for  each  system, 
the  phone  number  for  respondent  questions  was  written  inside 
each  questionnaire.  The  telephone  number  is  included  on  each 
questionnaire  to  handle  respondent  questions  promptly,  and  to 
create  uniform  interpretation  of  questions. 

• 

The  telephone  numbers  were  not  printed  on  the  questionnaire 
since  it  had  not  been  determined  at  printing  time  who  the  points 
of  contact  would  be.  A  record  of  respondent  problems  and 
questions  will  be  maintained  by  each  point  of  contact  on  a 
telephone  record  sheet  (Exhibit  G) .  This  will  ensure  uniformity 
of  resolutions  and  decisions,  and  also  provide  valuable  informa¬ 
tion  about  any  problems  with  the  survey. 

In  addition,  questionnaire  ID  numbers  were  written  on 
each  questionnaire.  Questionnaire  ID  numbers  were  developed  by 
sequencial  numbering  of  the  systems  list.  This  same  number  was 
transcribed  on  to  the  corresponding  route  sheet,  and  the  receipt 
log  (Exhibit  H) . 

D.  Survey  Cycle  One:  Status 

The  questionnaires  for  NAVSEA  will  be  sent  via  the  inter- 
Navy  mail  system  from  the  point  of  contact's  (POC' s)  Office.  A 
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route  sheet  (Exhibit  D)  will  be  completed  for  each  system  with 
the  appropriate  organization  code.  The  questionnaires  will 
arrive  at  the  top  level  for  each  such  organization  code  and  at 
such  office,  the  questionnaires  will  be  routed  to  the  most 
appropriate  individual  to  respond  for  each  particular  system. 

Originally  the  POC  for  NAVSEA  was  Mrs.  Katherine  Weik, 
Foreign  Liaison  Program  Head.  By  decision  of  NAVMAT,  the  POC 
was  changed  to  be  Mr.  Stanley  Marcus,  Director,  Office  of 
Research  and  Technology^  Actual  administration  of  systems 
level  questionnaires  began  the  week  of  February  25th. 

At  NAVELEX,  Mr.  Tony  Slaga,  Head,  International  Programs 
Office  is  to  be  the  point  of  contact,  and  George  Driscoll  will 
be  the  name  included  on  questionnaires  and  route  sheets  for 
respondent  questions.  Mr.  Slaga  did  not  develop  the  systems 
list  for  NAVELEX  from  the  original  list  developed  by  NAVMAT. 
Instead,  he  created  his  own  list  and  gave  the  list  to  Data 
Solutions.  However,  only  five  of  the  systems  on  that  list 
were  included  on  our  original  list,  and  visa  versa.  Mr.  Slaga 
checked  over  the  original  list  and  identified  30  additional 


1/  Whereas  the  contractual  requirements  for  Task  2  were  com¬ 
pleted  on  schedule  in  the  sense  that  an  effective  survey 
administration  was  devised  and  logistical  support  for  imple 
mentation  was  provided,  the  actual  administration  at  two  of 
four  Systems  Commands  was  delayed  due  to  Navy  difficulties 
in  assigning  a  point  of  contact  at  NAVSEA  and  NAVAIR,  and 
in  providing  a  cover  letter  to  accompany  the  questionnaire 
from  an  appropriate  officer  in  NAVMAT.  Details  of  the 
chronology  of  events  that  precipitated  the  delay  are  on 
record  and  will  be  made  available  upon  request. 

F 
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systems  for  cognizance  at  NAVELEX.  This  results  in  a  total  of 
80  systems  at  NAVELEX.  Actual  administration  of  systems  level 
questionnaire  began  the  week  of  February  18th. 

The 'point  of  contact  at  NAVAIR  will  be  Mr.  William  Norris-;  ? 
There  has  been  considerable  difficulty  in  devising  a  list  of 
NAVAIR  systems.  At  a  meeting  attended  by  Mr.  Norris,  Mr.  E.M. 
Tupman,  Director,  Security  Division,  Mr.  Winslow,  Mr.  Donleavy, 

Dr.  Gould  (DSC)  and  Ms.  Losonczy  (DSC)  on  March  5,  1980,  it  was 
agreed  that  NAVAIR  would  be  provided  with  an  operational  defini¬ 
tion  of  systems  and  that  a  memo  would  be  sent  out  to  appropriate 
offices  in  NAVAIR  which  would  include  this  definition  and  request 
a  list  of  NAVAIR  systems  under  Office  cognizance  be  returned.  An 
operational  definition  was  supplied  the  same  day,  and  further 
progress  towards  actual  implementation  of  the  administration  pro¬ 
cedure  awaits  the  compilation  of  this  list  in  Mr.  Norris’  office. 

Finally,  in  consultation  with  the  COTR,  it  was  decided  that 
cognizant  technical  experts  at  NAVMAT  could  also  make  a  substan¬ 
tial  contribution  to  the  data  collection  process.  A  briefing 
was,  therefore,  held  on  February  26,  1980,  attended  by  Mr.  Winslow, 
Mr.  Dunleavy,  three  targeted  experts  at  NAVMAT  (G.  Schubert, 

J.  Crane,  and  R.  Young)  and  R.  Gould  and  K.  Losonczy,  represent¬ 
ing  DSC.  By  agreement  at  this  briefing,  a  DSC  representative 
delivered  questionnaires  to  G.  Schubert  and  R.  Young  on  February 
28,  1980,  and  our  further  aid  in  the  administration  logistics 
at  NAVMAT  will  be  given  upon  their  request. 


See  Footnote  1,  on  preceding  page. 
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E.  Survey  Cycle  Two 

After  questionnaires  from  the  systems  level  respondents 
are  completed  and  returned  to  the  points  of  contact,  Mrs.  Gwen 
Morsch  of  Data  Solutions  will  abstract  the  name  of  persons  and 
subsystems  identified  by  the  systems  level  respondents  on  their 
questionnaires.  This  will  involve  three  consistency  checks: 

1.  the  response  to  question  8,  Systems  Identity 
questionnaire.  Part  I  should  be  "yes". 

2.  for  subsystems  listed  in  the  Systems  Identity 
Questionnaire,  Part  II,  a  corresponding  "yes" 
should  be  indicated  for  export  control  examin¬ 
ation  on  question  1. 

3.  question  2,  Systems  Identity  Questionnaire, 

Part  II,  should  list  those  subsystems  identified 
in  question  where  "yes"  is  indicated  for  examin¬ 
ation  of  export  control. 

In  cases  where  there  is  an  inconsistency  in  the  above 
response  pattern,  the  respondent  will  be  contact  to  clear  up 
the  ambiguity. 

Individuals'  names  abstracted  as  described  above,  will 
receive  survey  packets  identical  to  those  sent  to  the  systems 
level  respondents.  Subsystem  level  questionnaires  will  go 
through  the  same  receipt  control  and  editing  procedures  as 
followed  for  the  system  level  questionnaire,  cycle  one. 
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F.  Survey  Cycle  Three 


After  questionnaires  are  received  from  the  subsystem 
respondents,  device  level  respondents  will  be  identified  in 
the  same  way  as  were  the  subsystem  respondents,  but  from  the 
subsystem  respondents.  A  receipt  log  will  be  created,  etc., 
as  for  cycle  one  and  cycle  two. 

G.  Receipt  Control  and  Editing 

As  the  questionnaires  from  the  systems  level  respondents 
are  received  at  the  points  of  contact,  they  will  be  logged  in 
by  Mrs.  Morsch,  Field- Operations,  and  checked  for  completeness 
and  consistency  of  response.  If  there  are  any  questions  with 
a  questionnaire,  the  respondent  will  be  contact  for  clarifica¬ 
tion.  Non-respondents  will  be  followed  up  and  encouraged  to 
complete  and  return  their  responses. 


IV.  DATA  ANALYSIS 


Data  Solutions  was  also  tasked  "to  evaluate  input  data 
quality  and  validation  procedures  to  assure  that  the  mathema¬ 
tical  model  and  computational  procedures  are  appropriate  to  the 
problem  being  addressed".  Whereas  steps  taken  to  validate  the 
mathematical  model  for  data  analysis  and  to  insure  the  quality 
of  input  data  upon  receipt  have  been  detailed,  Data  Solutions 
has  also  proposed  additional  computational  procedures  to  facili¬ 
tate  the  correlation  of  the  questionnaire  findings  with  the 
deliberations  of  the  Critical  Technology  Assessment  Committees 
of  the  Naval  Research  Laboratory.  Specifically,  at  a  meeting 
held  on  January  28,  1980,  attended  by  DSC  representatives,  the 
COTR,  and  representatives  of  NARDAC,  DSC  consultants  proposed 
computational  procedures  to  be  employed  to  establish  criticality 
criteria  for  the  categorization  of  questionnaire  measures.  The 
following  points  were  made: 

•  Selection  of  criteria  for  criticality  measures 
from  the  DQ  must  be  made  by  examining  the  variabilit 
of  scores  for  any  particular  measure  across  systems, 
subsystems,  and  devices  assessed.  It  is  only  by 
comparison  with  other  scores  that  any  particular 
rating  can  be  meaningful. 

•  Measures  of  interest  should  be  converted  to 
standardized  scores  (z  scores)  by  use  of  the 
following  formula: 


z 
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■  X  -  M 

s 

®  "normalized"  score 

■  mean  "normalized"  score  across  level 
(system,  subsystem,  device) 

=  variance® 
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In  this  form,  the  mean  (m)  of  the  standarized  scores 
will  always  equal  zero  (o) ,  and  the  standard  devia¬ 
tion  will  always  equal  one  (1) .  Further,  changing 
the  scores  in  any  distribution  to  "z"  scores  does 
not  alter  the  shape  {or  mathematical  form)  for  the 
distribution.  The  frequency  of  any  given  "z"  score 
is  exactly  that  of  the  "x"  score  corresponding  to 
it  in  the  distribution. 

•  Our  suggestion  that  each  level  of  the  DQ  (system, 
subsystem,  device)  be  standardized  independently 
is  based  on  the  assumption  that  the  form  of  these 
distributions  will  vary,  or  that  at  least  the  latter 
two  will  differ  from  the  system  level  distribution. 
This  is  due  to  the  fact  that  at  the  subsystem  and 
device  levels,  equipment  has  a  priori  been  identifiec 
as  potentially  containing  critical  technology. 

To  check  this  assumption,  we  would  suggest  that 
the  distribution  of  "normalized"  scores  also  be 
plotted  for  each  level,  and  the  hypothesis  that 
the  mean  subsystem  and  device  score  will  be  higher  | 
than  the  mean  system  score  be  checked,  (An  analysis 
of  variance  for  unequal  Ns  as  given  in  Winer,  1971 
may  be  used  to  check  for  statistical  significance 
if  this  is  desired) . 

•  The  final  step,  selecting  criterion  values  of  criti¬ 

cality  for  each  measure  of  interest,  may  then  be 
based  on  the  standard  deviation,  and  the  criticality 
category  may  be  assigned  as  appropriate  to  the  level 
of  the  questionnaire.  For  example,  the  system  level 
distribution  of  standardized  scores  for  the  measure 
"Need  to  Control-Technical  Data"  may  be  depicted  as 
follows:  * 
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Standard  Deviations 


(Mean) 


Standard  Deviations 

,  |  |  Highly 

Not  Questionable  .  Critical  I  Critical 

Critical  j  Criticality  ^  Technology  |  Technology 

At  the  subsystem  or  device  level ,  the  categories  may  be 
altered;  e.g.: 


-3  -2  -1 

Standard  Deviations 

I 

Questionable  | 
Criticality  j 
I 


0 

(Mean) 

Critical 

Technology 


+1  +2  +3 

Standard  Deviations 
I  I 

j  Highly  I 

|  Critical  | 

Technology  | 


In  addition,  in  conjunction  with  the  COTR,  DSC  presented 
NARDAC  representatives  with  the  following  priority  list  for 
analysis; 

~  1.  Need  (T.D.)  x  Need  (E.P.)  x  Need  (K.E.) 

2.  (Need+Can+How)  x  (Need+Can+How)  x  (Need+Can+How) 

T.D.  E.P.  K.E. 

3.  Can  (T.D.)  x  Can  (E.P.)  x  Can  (K.E.) 

4.  How  (T.D.)  x  How  (E.P.)  x  How  (K.E.) 

5.  Need  (T.D.) 

6.  Need  (E.P.) 

7.  Need  (K.E.) 

8.  Can  (T.D) 

9.  Can  (E.P-) 

10.  Can  (K.E.)  . 

11.  How  (T.D.) 

12.  How  (E.P.) 

13.  How  (K.E.) 


T.D.  =  Technical  Data 
E.P.  =  End  Product 
K.E.  =  Keystone  Equipment 
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V.  METHODS  OF  CRITICAL  TECHNOLOGY  ASSESSMENT 
COMMITTEES  THE  NAVAL  RESEARCH  LABORATORY 


On  January  21,  1980,  an  orientation  meeting  was  held  at 
the  MIC  Building  at  NRL  for  key  individuals  involved  in  the 
Critical  Technology  Assessment  process  for  the  Navy.  Data 
Solutions  was  represented  by  John  Proctor,  Robert  Gould,  and 
Kathy  Losonczy.  Key  personnel  from  the  Navy  included  Captain 
Fred  Hueber  and  Jack  Dunleavy  (NAVMAT) ,  Captian  Richard  Coe 
(OP-62) ,  Les  Winslow  (NRL) ,  Carla  Askins  (NARDAC) ,  and  approxi¬ 
mately  thirty  (30)  individuals  selected  to  participate  in  the 
Critical  Technology  Assessment  Committees.  At  this  meeting 
Captain  Hueber,  the  keynote  speaker,  summarized  the  chronology 
of  events  that  have  led  to  the  Navy  approach  to  systematically 
respond  to  the  Export  Administration  Act  (1979)  mandate  to  pro¬ 
vide  a  list  of  critical  technologies  and  critical  technology 
experts  to  be  listed  in  the  Federal  Register  by  January  10,  1980, 
and  outlined  the  method  by  which  the  contribution  of  the  Navy  to 
the  technology  Working  Groups  of  the  Institute  of  Defens  .•  Analy¬ 
sis.  Mr.  Winslow  presented  a  detailed  briefing  concerning  the 
formation,  breakdown,  coordination,  scheduling,  and  outputs  of 
the  committees.  He  then  introduced  DSC  consultants  and  describe  1 
our  dual  role  in  relation  to  questionnaire  data  collection  and 
transmission  to  committees,  and  the  provision  of  guidelines  for 
committee  operating  methods.  Dr.  Proctor  then  commented  and 
elaborated  on  Data  Solutions  role  in  facilitating  the  commit¬ 
tees'  efforts. 


Through  the  efforts  of  Mr.  Winslow,  in  consultation  with 
DSC,  a  series  of  three  meetings  were  planned  for  the  Chairs  of 
the  Critical  Technology  Assessment  Committees  (CTAC) .  The  pur 
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detailed  information  concerning  the  goals,  available  data 
resources,  desired  products,  and  schedules  of  committee  inter¬ 
action,  and  to  solicit  input  from  Chairs  concerning  the  methods 
and  guidelines  by  which  committee  operations  would  be  per¬ 
formed.  In  addition  to  Drs.  Gould  and  Proctor,  these  meetings 
were  attended  by  a  Data  Solutions  specialist  in  organizational 
behavior,  Dr.  Harry  Ammerman.  These  meetings  were  held  on 
February  10,  1980  and  February  11,  1980.  On  February  14,  1980 
Data  Solutions  submitted  a  draft  version  of  Guidelines  for 
Critical  Technology  Assessment  Committees  to  Mr.  Winslow.  A 
slightly  revised  version  of  these  Guidelines  (Exhibit  I)  is 
now  being  prepared  for  dissemination  to  all  Committee  Chairs. 
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Instructions  to  Technology  Identification  Questionnaire 


1.  Program  Designation  Is  for  Identification  purposes.  Example:  KAYSEA 
652  -  Surveillance  System. 

2.  System  Designation  and  Manufacture  is  for  specification  of  the  equipment 

being  described  on  the  questionnaire.  ; 

’  1  •  .  i 

3.  Level,  Indicates  which  level  of  the  subdivision  of  the  system  Is  described 

in  the  questionnaire.  C* 

4.  Sublevel  Designation  and  ‘^./acturer;  specify  the  specific  subdivision 
of  the  equipment  by  name  and  ifacTHfer.  Example:  Amplitron,  QKS-8129 
Raytheon. 

5.  Subdivision  of  (3);  Specify  the  name  of  the  subsystem,  device  or  component 
and  its  function.  Indicate  the  technology  which  best  describes  the  important 
aspects  of  the  specific  subdivision  being  discussed.  The  technology  may  be 
design  or  fabrication;  it  may  be  a  solid  state  device,  a  component  or  material. 
Does  the  system  contain  a  technoloy  or  end  product  which  provides  a  unique 
capability  which  the  Navy  should  protect  (answer  yes  or  no).  If  the  answer- is 
affirmative,  designate  someone  in  the  Navy  to  answer  the  Data  Questionnaires, 
and  this  Technology  Identification  Questionnaire.  Forward  blank  copies  of  the 
instructions  and  the  questionnaires  to  that  Designated  Individual.  (If  desired 
two  or  three  levels  of  the  questionnaire  can  be  completed  by  the  same  individual 
if  the  individual  has  the  required  knowledge). 

6.  Return  completed  copies  to  the  person  who  completed  the  system  level  TIQ, 
for  forwarding  to  NAVMAT  08D2. 


EXHIBIT  A:  Pilot  Questionnaire 


Instructions  te  Data  £uestloau)jrg 

1.  The  questions'  in  this  quest! onaire  ere  selected  to  allow  the  categoriaatiox 
of  technologies  vhich  say  require*  added  protection  frea  enesy  acquisition. 

The  questions  are  related  to  silitary  capabilities ,  security,  classifications, 
aanufacturing  characteristics ,  funding,  and  nev  technologies.  The  ansvers 
vill  he  subjective  by  necessity  9*  don't  slad  putting  a  "don't  know"  if 
you  don^t  have  the  ansvers  questionaire  should  be  eccpleted  in  about 
ten  (10)  minutes.  _ 

2.  This  questionaire  is  ccn,  —nenttry  to  the  Technology  ‘Identification 
Question aire  (TIQ).  One  of  these  should  be  completed  for  each  level  and 
subdivision  of  that  questionaire  (ZXQ).  Blank  copies  of  this  Bata  Questionaire 
should  be  forwarded  to  the  Designated  Individual  to  be  ecspleted  and  returned 
to  KAVKAT. 

3*  Be  turn  completed  conies,  along  with  the  Technology  Identification  Question 
aire  to  BAYMAT  OSDS.. 


EXHIBIT  A  (cont’d) 


Data  questionnaire  Level  • 
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EXHIBIT  A  (cont’d) 


jb  End  product  susceptible  to  reverse  engineering 
(c  Processing  equipment 


(a)  Is  this  technology  most  closely  related  to  device  or  system 
Integration?  (Check  one  only) 

(b)  Is  the  technology  of  this  equipment  based  on  a  fabrication/ 
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EXHIBIT  A  (cont'd) 


15.  Is  the  technology  base  primarily  driven  by  commercial  H&D  or'mllltary 
R&D  fundtno?  Coninerclal _ _  Military _ 
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EXHIBIT  a  (cont.d) 


25.  Doqs  this  equipment  use  technologies  or  components  developed  since 
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EXHIBIT  A  (uont'd) 


32.  Is  the  equipment  In  the  civilian  sector  more  advanced  or  equivalent 
to  that  equipment  that  has  been  most  recently  deployed  by  the  U.S. 
Navy? 


U.s.  NAVY  MATERIAL  COMMAND 
TECHNOLOGY  TRANSFER  ASSESSMENT  SURVEY 


BACKGROUND  . 

The  Export  Administration  Act  -  1979  and  OPNAVINST  5510.156  mandate  that  the  control  of  dealgn  and 
manufacturing  know-how,  In  addition  to  critical  military  and  products  of  technology,  la  abaolutely  vital  to 
the  maintenance  of  U.S.  technological  superiority.  In  this  regard,  the  Department  of  Defense  has  been  urg¬ 
ed  to  aid  In  maintaining  the  U.S.  strategic  technology  lead  by  developing  policy  objectlvea  and  strateglea  for 
the  export  control  of  critical  technologies. 

In  order  to  achieve  this  goal  It  ia  essential  that  specific  critical  technologies  be  systematically  identified  and  asses¬ 
sed  with  regard  to  the  necessity,  feasibility,  and  method  of  export  control  to  foreign  countries.  Toward  this  pur¬ 
pose  the  Critical  Technology  Assessment  Office,  under  the  auspices  of  the  Navy  Material  Command,  is  con 
ducting  the  TECHNOLOGY  TRANSFER  ASSESSMENT  SURVEY. 

Your  contribution  to  this  assessment  is  vital  and  will  be  greatty  appreciated  as  .your  knowledge  and  judgment  is  the 
major  source  of  data  for  this  study.  As£  participant  you  are  asked  to  respond  to  the  enclosed  SYSTEMS  IDENTITY 
QUESTIONNAIRE  and  DATA  QUESTIONNAIRE. 

The  data  you  supply  will  be  computer  analyzed  by  a  pre-tested  mathematical  model,  and  the  results  will  be  Inte¬ 
grated  by  panels  of  leading  experts  from  government,  industry,  and  academia.  The  final  outcome  of  this  process 
will  be  a  computer  supported  data-base,  amenable  to  updating,  which  lists  specific  critical  technologies,  assesses 
optimal  methods  for  the  control  of  their  export,  and  provides  a  roster  of  cognizant  technical  experts. 

SURVEY  INSTRUMENTS 

This  survey  booklet  Includes  three  parts:  a  SYSTEMS  IDENTITY  QUESTIONNAIRE,  PART  I  (yellow  pages),  a 
SYSTEMS  IDENTITY  QUESTIONNAIRE,  PART  II  (green  pages)  and  a  DATA  QUESTIONNAIRE  (blue  pages). 
The  questionnaires  have  been  designed  for  ease  of  response;  the  majority  of  questions  require  a  multiple  choice 
answer. 

The  SYSTEMS  IDENTITY  QUESTIONNAIRE,  PART  I  (yellow  pages)  asks  you  to  identify  the  technology  or  hard¬ 
ware  about  which  you  are  completing  this  survey  booklet  and,  to  ascertain  whether  sub-systems  or  devices 
exist  which  you  feel  should  be  evaluated  for  export  control. 

The  SYSTEMS  IDENTITY  QUESTIONNAIRE,  PART  II  (green  pages)  asks  you  to  provide  identifying  information 
about  subsystems  or  devices  which  you  feel  should  be  examined  for  export  control  and  to  name  an  appropriate 
Individual  to  respond  to  a  survey  booklet  for  each  such  subsystem  or  device. 

The  DATA  QUESTIONNAIRE  (blue  pages)  asks  questions  about  the  characterises  of  the  technology/hardware 
that  you  identified  In  the  SYSTEMS  IDENTITY  QUESTIONNAIRE,  (yellow  pages)  so  that  necessity  and  feasi¬ 
bility  of  export  control  can  be  evaluated. 


*  Additional  background  lor  tt>a  praaant  a  tody  may  ba  found  in  "An  Anatyala  of  Export  Control  of  U.S  Technology  —  A  POD  ParapocHva". 
ODDRE.  4  February  1676 


HEAO.  CRITICAL  TECHNOLOGY 
ASSESSMENT  OFFICE 
NAVAL  RESEARCH  LABORATORY 
WASHINGTON  OC  20375 

FORM  » 


PLEASE  00  TO  NEXT  PAGE 


SURVEY  METHODOLOGY 


The  TECHNOLOGY  TRANSFER  ASSESSMENT  SURVEY  has  been  designed  to  collect  data  lor  a  given  tech¬ 
nology  or  hardware  system  at  the  system  level,  subsystem  fevei  and  device  levei  as  follows: 

system  levei  —  one  survey  booklet  should  be  completed  for  every  technology /hardware  system  In  the  survey. 

subsystem  levei  —  a  survey  booklet  should  be  completed  (or  every  subsystem  of  a  technology/hardware  system 
which  the  respondent  at  the  system  level  feels  should  be  examined  for  export  control. 

device  level  —  a  survey  booklet  shouid  be  completed  for  every  device  of  a  subsystem  which  the  respondent  at 
the  subsystem  level  feeis  should  be  examined  for  export  control. 

if  you  are  knowledgeable  about  a  given  te otology /hardware  at  more  than  one  levei  then  it  is  acceptable  for  you 
to  complete  a  survey  booklet  for  each  su-  hsystem  or  device . 


IF  YOU  HAVE  ANY  QUESTIONS  THAT  YOU  NEED  TO  ASK  IN  REGARD  TO  THIS  SURVEY.  PLEASE 
CALL _ 


DEFINITIONS 

critical  technology 

This  is  the  "know  how"  whose  acquisition  by  another  nation  wouid  significantly  enhance  the  military  operational 
capability  of  such  nation,  irrespective  of  whether  such  technology  is  acquired  directly  from  the  United  States  or 
indirectly  through  another  recipient,  or  whether  the  declared  end-use  intentions  by  the  recipient  are  for  military 
or  nonmilitary  purposes. 

keystone  equipment 

This  is  the  manufacturing,  inspection  or  automatic  test  equipment  which  can  significantly  contribute  in  and  of 
themselves  to  the  transfer  of  critical  technology  because  they  1 )  embody  extractabie  critical  technology,  or  2) 
are  equipment  which  completes  a  process  iine  and  allows  it  to  be  fully  utilized. 

technical  data 

This  means  that  information  of  any  kind  which  can  be  used,  or  adapted  tor  use,  In  the  design,  production,  manu¬ 
facture.  utilization,  testing,  maintenance  or  reconstruction  of  articles  or  materials  The  data  may  take  a  specific 
form  such  as.  a  model,  prototype,  blueprint,  or  an  operating  manual,  or  flow  in  less  tangible  forms  such  as  tech¬ 
nical  services  or  interactions. 

technology 

Technology  is  the  "know  how"  used  in  the  design,  production,  manufacture,  testing,  utilization  or  maintenance 
of  materials 


export  control 

Export  control  refers  to  control  of  transfer  of  U  S.  technology  to  foreign  countries  In  order  to  protect  critical  tech¬ 
nologies  from  enemy  acquisition 


PLEASE  00  TO  NEXT  PAOE 


SYSTEMS  IDENTITY  QUESTIONNAIRE 


PARTI:  Identification  of  (tie  technology/hardware  subject. 


1 .  Name  of  person  completing  questionnaire: _  omr 

organizatlgn/code  - . — .  . -  _ _ _ _  —  pt**>  ; 

area  code  and  telephone  number  _ _  _ ,  . . -  «md 

level  of  your  response:  (CIRCLE  EITHER  1 . 2,  or  3  to  INDICATE  LEVEL  OP  DETAIL  AT  WHICH  YOU  ARE 
RESPONDING) 


system  level  ....  1 
subsystem  level .  2 
device  level . 3 

2.  Identify  the  system  in  which  the  technology/hardware  is  embedded,  which  is  the  subject  of  this  questionnaire, 
and  give  a  brief  description  (1 0-1 5  words)  of  the  function  of  that  system.  Include  the  subsystem  name  or  de¬ 
vice  name  according  to  the  level  of  your  response: 


system  name:  . . . . . --  »«> 

system  function: _ ; _  «»'«i 


subsystem  name:  _ _ — _ _ — _ _ _  (mi-itd 

device  name:  _ _ 


COMPLETE  THE  REMAINDER  OF  THIS  QUESTIONNAIRE  AND  THE  FOLLOWING  DATA 
QUESTIONNAIRE  (BLUE  PAGES)  FOR  THE  LEVEL  YOU  INDICATED  IN  QUESTION  1  ABOVE. 


3.  Enter  the  name  of  the  manufacturer  of  the  technology/hardware  at  the  level  of  your  response: 

_  CWMM) 

4.  Give  a  brief  description  (10-30  words)  of  the  function  of  the  technology/hardware  described  above.  If  you  are 
responding  at  the  system  level,  this  wR  be  the  same  as  system  function  above,  otherwise  enter  function  for  the 
appropriate  level: 


0HW 


PLEASE  00  TO  NEETPAOE 


5.  Indicate  the  technology  areas  which  best  represent  the  technology  /hardware  described  in  this  questionnaire: 
(CIRCLE  EITHER  ONE  OR  UP  TO  FOUR  CODES  TO  INDICATE  YOUR  RESPONSE) 


computer  network . 

.01 

microwave  componentry . 

. 11 

(4XI414) 

large  computer  system . 

.02 

military  turbine  engine . 

. 12 

fltf 

software  technology . 

.03 

fiber  and  advanced  optics . 

. 13 

IUT4M) 

automated  real-time  control . 

.04 

sensor  technology . 

. 14 

Hit  1Jff) 

materials,  structure,  fabrication . 

.05 

undersea  system . 

. 16 

directed  energy . 

.06 

nuclear . 

. 16 

LSI* VLSI  design  and  manufacturing . . 

.07 

chemical . 

. 17 

military  instrumentation . 

.08 

cryptography . 

. 18 

telecommunications . 

.09 

EW. /radar . 

. 10 

guidance  and  control . 10 


6.  Is  this  equipment,  or  a  close  derivative  sold  under  Foreign  Military  Sales?  (CIRCLE  EITHER  "Y"  OR  “N"  TO 
INDICATE  YOUR  RESPONSE) 


yes . Y  (MU 

no . N 


7.  Are  there  different  names  of  commercial  derivatives  of  this  equipment  that  are  add  either  commercially  or 
under  foreign  military  sales?  (CIRCLE  EITHER  “Y'‘  OR  "N"  TO  INDICATE  YOUR  RESPONSE) 


yes . Y  (M» 

no . ...N 

name(s)  of  commercial  derivatives  If  "yes"  above:  mi on 


ANSWER  QUESTION  8  IF  YOU  ARE  RESPONDING  AT  THE  SYSTEM  OR  SUBSYSTEM  LEVEL  W  YOU  ARE 
RESPONDING  AT  THE  DEVICE  LEVEL  QO  TO  DATA  QUESTIONNAIRE  (BLUE  PAGES). 


8.  Do  you  believe  there  are  technologies  embedded  in  me  level  described  in  this  questionnaire  that  should  be 
evaluated  for  export  control?  (CIRCLE  EITHER  "Y"  OR  "N”  TO  INDICATE  YOUR  RESPONSE) 


yes . Y  son 

no . N 


r 


IF  YOU  ANSWERED  "YES”  FOR  QUESTION  8  GO  TO  PART  II  OF  SYSTEMS  IDENTITY  QUESTIONNAIRE 
(GREEN  PAGES)  OTHERWISE  IF  YOU  ANSWERED  “NO"  SKIP  GREEN  PAGES  AND  GO  DIRECTLY  TO 
TO  DATA  QUESTIONNAIRE  (BLUE  PAGES). 


SYSTEMS  IDENTITY  QUESTIONNAIRE 


PART  II:  Identification  of  subdivisions  of  the  technology /hardware  Identified  in  PART  I  of  this  questionnaire. 


1 .  Identify  the  subdivisions  of  the  technology /hardware  described  at  the  lowest  level  of  detail  In  PART  I  of  this 
questionnaire.  If  you  are  responding  st  the  system  level;  then  subdivision  refers  to  subsystem,  or  If  you  are| 
responding  at  the  subsystem  level;  subdivision  refers  to  device.  Indicate  If  each  subdivision  should  be  ex* 
•mined  for  export  control.  (CIRCLE  EITHER  “Y"  OR  "N"  TO  INDICATE  YOUR  RESPONSE) 


Examine  for  export  control 

Name  of  subdivision  yes  /  no 


A 

Y 

N 

(965) 

R 

. 

Y 

N 

e 

. 

Y 

N 

JM9) 

n 

Y 

N 

VZT) 

E. 

Y 

N 

IF  YOU  IDENTIFY  MORE  THAN  FIVE  SUBDIVISIONS  THEN  USE  AN  ADDITIONAL  SHEET  OF  PAPER  AND 
ATTACH.  INCLUDE  QUESTION  2  INFORMATION  FOR  EACH  ADDITIONAL  SUBDIVISION  WHICH  YOU 
BELIEVE  SHOULD  BE  EXAMINED  FOR  EXPORT  CONTROL 


IF  YOU  INDICATED  “YES”  IN  QUESTION  1  FOR  EXPORT  CONTROL  OF  ANY  SUBDIVISION,  COMPLETE 
QUESTION  2  FOR  EACH  SUCH  CASE.  OTHERWISE  LEAVE  QUESTION  2  BLANK  AND  QO  TO  DATA 
QUESTIONNAIRE  (BLUE  PAGES). 


2.  Give  information  below  for  the  subdivisions  identified  in  QUESTION  1 ,  PART  II  of  this  questionnaire  which  you 
bejjeve  should  be  examined  for  export  control.  "Name  of  contact”  refers  to  the  name  of  the  individual  who  wB 
complete  a  SYSTEMS  IDENTITY  QUESTIONNAIRE  and  a  DATA  QUESTIONNAIRE  for  that  subdivision. 


A.  name  of  subdivision: _  iummi 

function  of  technology/ 

hardware  of  subdivision:  _  awmi 

name  of  contact:  imrui 

organization  code  of  contact:  _  imm 

telephone  number  and  area  code  of  contact:  _ 

B.  name  of  subdivision: _  roam 

function  of  technology/ 

hardware  of  subdivision:  _ _ ; _  warn 

name  of  contact:  _ 

organization  code  of  contact:  _  ««««» 

telephone  number  and  area  code  of  contact:  _ 


C.  name  of  subdivision; _ 

function  of  technology/ 

hardware  of  subdivision: _ ; -  ewiowi 

name  of  contact;  _ ] _  (io»io»> 

organization  code  of  contact;  .  . -  —  -  -  trama 

telephone  number  and  area  code  of  contact:  -  _ . .  om>mu> 

0.  name  of  subdivision: _  aw-iom 

function  of  technology/ 

hardware  of  subdivision:  _  cm-iwi 

name  of  contact:  (n»m*i 

organization  code  of  contact _  meimi 

telephone  number  and  area  code  of  contact:  _ _ . _  noviw) 

E.  name  of  subdivision: _ _ _  nm  iw 

function  of  technology/ 

hardware  of  subdivision: _  iimiwi 

name  of  contact:  -  _  _  cmr  im> 

organization  code  of  contact: _  owim 

telephone  number  and  area  code  of  contact:  _ _ _  mw me 


if 


DATA  QUESTIONNAIRE 


The  questions  In  this  questionnaire  were  selected  to  allow  for  the  estegorlsetlon  of  technologies  whleh 
require  added  protection  from  enemy  acquisition.  The  questions  are  related  to  military  capabilities, 
security  classifications,  manufacturing  characteristics,  funding,  end  new  technologies. 

i 

1.  Of  the  following  group  of  nations  indicate  which  ones  the  U.S.  has  a  lead  of  three  or  more  years  In  rnHtary 
capability  in  regard  to  this  technology.  (CIRCLE  ONE  NUMBER  ON  SCALE  BELOW  TO  INDICATE  YOUR 
RESPONSE  FOR  EACH  GROUP) 


Confident 
that  U.S. 
does  not 


Confident 
that  U.S. 
does 


NATO .  1 . 2 . 3 . 4... . 5  p»« 

WARSAWPACT .  1 . 2 . 3 . ..4 . 5  m 

PEOPLES  REPUBLIC  OF  CWNA  1 . 2 . 3 . 4 . 5  pci) 

THIRD  WORLD .  1 . 2 . 3 . 4 . 6  nsa> 


2.  Do  you  believe  the  WARSAW  PACT/PEOPLES  REPUBLIC  OF  CHINA  would  replace  their  equipment  or 
technology  with  ours  If  they  had  ful  data  on  how  to  make  our  equipment?  (CIRCLE  ONE  NUMBER  ON  SCALE 
BELOW  TO  INDICATE  YOUR  RESPONSE) 


Confident  Confident 

that  they  that  they 

would  not  would 

1 . 2 . 3 . 4 . 6  m 


3.  Does  this  technology  support  a  revolutionary  growth  In  mStary  capabfflty?  (CIRCLE  ONE  NUMBER  ON  SCALE 
BELOW  TO  INDICATE  YOUR  RESPONSE) 


Confident 

Confident 

that  It 

that  It 

does  not 

does 

1 . 

2  . . 

. 3 . 

. 4  ... 

. 6 

4.  Would  compromise  of  operational  or  performance  Information  about  this  equipment  seriously  degrade  Its 
mlitary  utfity?  (CIRCLE  ONE  NUMBER  ON  SCALE  BELOW  TO  INDICATE  YOUR  RESPONSE) 

Confident  Confident 

that  It  that  It 

would  not  would 

1 . 2 . 3 . 4 . 6  mtu 


ANSWER  QUESTION  5  and  6  ONLY  IF  SPECIFIC  EQUIPMENTS  ARE  INVOLVEO,  AS  OPPOSED  TO 
TECHNOLOGICAL  KNOW-HOW,  OTHERWISE  QO  TO  QUESTION  7. 


5.  Is  either  of  this  equipment’s  software  technical  manuals  or  applications  software  classified?  (CIRCLE 
EITHER  "Y"  OR  "N"  TO  INDICATE  YOUR  RESPONSE) 


yea . Y  on® 

no . N 


If  "yes"  above  Indicate  security  level _  oxr-ism 

6.  is  this  equipment’s  hardware  classified?  (CIRCLE  EITHER  "Y”  OR  ”N"  TO  INDICATE  YOUR  RESPONSE) 


yes . Y  nw) 

no . N 


If  "yes”  above  indicate  security  level _  om-tun 

7.  Which  of  the  following  relates  to  the  most  important  aspect  of  the  technology  transfer  at  this  level?  (CIRCLE 
ONE  CODE  TO  INDICATE  YOUR  RESPONSE) 


data  (operational  or  technical) . A  m 

end  product  susceptible  to  reverse  engineering . B 

fabrication  and/or  material  processing . C 


8.  Indicate  which  of  the  following  best  describes  this  technology:  (CIRCLE  ONE  CODE  TO  INDICATE  YOUR 
RESPONSE) 


the  technology  Is  most  closely  related  to  device  or  system 

integration . A  m 

the  technology  of  this  equipment  is  based  on  a  fabrication/ 

manufacturing  capability . B 

the  essence  of  this  technology  Is  principally  the  managerial 
skills  and/or  engineering  that  allow  for  successful  design 

engineering,  and  fabrication . C 


9  Is  unique  keystone  equipment  /equipment  that  is  absolutely  essential  for  economically  viable  production) 
essential  for  manufacture  of  this  equipment?  (CIRCLE  EITHER  T’  OR  ”N”  TO  INDICATE  YOUR  RESPONSE) 


yes . Y  nim 

no . N 


1  o  Do  you  believe  that  it  would  take  more  then  three  years  for  the  folowing  nations  to  acquire  the  manufacturing 
capability  of  this  technology  upon  acquisition  of  a  unit  of  this  equipment?  (CIRCLE  NUMBER  ON  SCALE 
BELOW  TO  INDICATE  YOUR  RESPONSE  FOR  EACH  GROUP) 


Confident 

Confident 

that  it 

that  it 

would  not 

would 

NATO . 1 . 

....2 . 

. 3 . 

. 4  ... 

WARSAW  PACT . 1  . 

. . .  .2 . 

. 3 . 

. 4  ... 

. 6 

(inn 

PEOPLES  REPUBLIC  OF  CHINA  1  . 

*•••2  ••••• 

•  •  •  •  •  3 . 

. 4  ... 

. 6 

tnm 

THIRO  WORLD . 1 . 

» •  •  •  2  ••••• 

. 3 . 

. 4  ... 

. 6 

11.  For  the  technology  at  this  level  Indicate  whether  It  la  baaed  on  highly  trained  personnel  (or  aach  of  the  fol¬ 
lowing:  (CIRCLE  EITHER  “Y”  OR  “N“  TO  INDICATE  YOUR  RESPONSE) 

Yas  NO 

design  of  production  equipment . Y  N  t*m 

operation  of  production/processing  equipment . . . Y  N  nan 

operation  of  tasting/calibration  equipment . Y  N  own 


"Y"  OR  “N"  TO  INDICATE  YOUR  RESPONSE) 

Yes  No 

subsystems . Y  N  pa «■> 

devices . Y  N  om 

components . Y  N  pant 

materials . Y  N  oaaii 

1 3.  How  would  you  classify  the  technology  category  of  the  level  of  this  equipment?  (CIRCLE  ONE  CODE  TO 
INDICATE  YOUR  RESPONSE)  . 

older  technology,  equivalent  substitute  available . A  nan 

older  technology,  no  substitute,  little  growth  forecast . B 

older  technology,  substantial  growth  forecast . C 

long  term  emerging  technology . D 

near  term  emerging  technology . E 

14.  Indicate  whether  the  technology  is  primarily  driven  by  commerdol  RAD  or  by  military  R&D  funding:  (CIRCLE 
ONE  CODE  TO  INDICATE  YOUR  RESPONSE) 

commercial  R&D. funding . A  oats 

military  R&D  funding . B 

1 5 .  Tndteate  whether  the  technology  base  is  primarily  driven  by  commercial  sales  or  by  mltary  sales:  (CIRCLE  ONE 

CODE  TO  INDICATE  YOUR  RESPONSE) 

commercial  sales . A  oat*) 

military  sales . B 

10.  la  there  a  useful  distinction  between  the  type  of  technology  exploited  by  the  mffitary  versus  that  exploited  by 
CM  sector?  (CIRCLE  EITHER  "Y"  OR  "N"  TO  INDICATE  YOUR  RESPONSE) 

yea . Y  nan 

no . N 


17.1*  ther#  a  leg  in  military  application  of  this  technology  behind  civilian  application  of  thla  technology?  (CIRCLE 
EITHER  T  OR  "N"  TO  INDICATE  YOUR  RESPONSE) 


yea .  . Y  am 

no . N 


18.  Are  the  manufacturing  sources  for  commercial  product*  different  than  the  manufacturing  eourcea  for  miitary 
products?  (CIRCLE  EITHER  T  OR  “N"  TO  INDICATE  YOUR  RESPONSE) 


yea . Y  am 

no . N 


1 9.  Are  there  key  componenente  or  aubaseembtiea  found  within  this  equipment  that  merit  export  oontroi  due 
to  their  mtttary  utility  upon  removal?  (C1R3^£  NUMBER  ON  SCALE  BELOW  TO  INDICATE  YOUR  RESPONSE) 

Confident  Confident 

that  there  that  there 

are  not  are 

1 . 2 . 3 . 4 . 6  (taw 


20.  Are  there  extractable  technologies  contained  within  key  components  or  aubeaaembNes  on  thla  equipment 
that  merit  export  control?  (CIRCLE  EITHER  “Y"  OR  MNM  TO  INDICATE  YOUR  RESPONSE) 


yea . Y 

no . N 


21 .  Is  there  a  manufacturing  methods  program  directly  applicable  to  this  technology?  (CIRCLE  NUMBER  ON 
SCALE  BELOW  TO  INDICATE  YOUR  RESPONSE) 


Confident  Confident 

that  there  that  there 

are  not  are 

1 . 2 . 3 . 4 . 6 


0 

I 

22.  Rate  the  relative  Importance  of  the  following  technical  processes  of  this  technology:  (RATE  1  to  10  WHERE 
SUMMATION  OF  RATINGS  EQUALS  1 0) 


design 

fabrication 

orocesalno 

itiYiitm 

testing 

1 


sum 


10 


1 


29.  te  there  a  u— fu>  dtetinctton  between  dvian  sppCcatioos  ot  equipment  vwm  mitary  appfoatore  ct  equipment? 
(CIRCLE  EITHER  "Y”  OR  ,,N*’  TO  INDICATE  YOUR  RESPONSE) 


yes . Y  m 

no . N 


30.  Is  the  equipment  in  the  dvtlien  sector  either  more  advanced  or  equivalent  to  standard  U.8.  Navy  equipment? 
(CIRCLE  EITHER  "Y"  OR  "N”  TO  INDICATE  YOUR  RESPONSE) 


yas . Y 

no . N 


tuff) 


31.  Is  the  equipment  in  the  cMNen  sector  either  mors  advanoed  or  equivalent  to  equipment  which  has  baan  most 
recently  deployed  by  the  U.S.  Navy?  (CIRCLE  EITHER  “Y"  OR  "N"  TO  INDICATE  YOUR  RESPONSE) 


yw . Y  oh 

no . N 


THANK  YOU  FOR  YOUR  TIME  AND  PARTICIPATION.  THE  IMPORTANCE  OF  YOUR  C0NTWBUT10N  CAN¬ 
NOT  BE  OVER-EMPHASIZED.  PLEASE  LOOK  OVER  YOUR  RESPONSES  AND  PLACE  THIS  BOOKLET  IN 
ENVELOPE  PROVIDED,  AND  RETURN  IT  TO _ 


ORGINIAL  SYSTEMS  LIST 


Active  homing  missiles 
Condor 

AGM  53A 

Condor  Dual  Mode 
Harpoon 

AGM-84A 

SHIP  AND  SUBMARINE  SYSTEMS 
Surveillance 


SPS-29E 

(62X) 

SPS"32 

(62X) 

SPS-37A 

(62X) 

SPS-40B 

(62X) 

SPS-43A 

(62X) 

-SPS-49 

(62X) 

SPS-58 

(62X) 

TAS  Radar  Auto  (62Z5) 


3D  Air  Search 


SPS-30A 

(62X) 

SPS-33 

11 

SPS-39A 

tl 

SPS-42 

SPS-48A(V) 

VI 

S PS-48 (ATD) 

If 

SPS-52 

VI 

SPS-52B 

VI 

SPS-52C 

n 

SPY-1A 

(62X) 

(AEGIS) 

Surface  Search 

SPS-1UF 

(62X) 

S'PS-55 

(62X) 

Submarine  Search 

BPS-5A-C 

(62X) 

BPS-9A,C 

ft 

BPS-12 

fl 

BPS-13 

VI 

BPS-14 

II 

BPS-15 

(62X) 

TV 

"VIMS  (6  HI) 

BXQ- 3/Type  15  (6111) 

Periscope  (6111) 
Type  18 

Periscope  (6111) 


/ 


EXHIBIT  D: 

'  & 


Original  Systems  List 


_SCBIS _ _ - 

SIRED  (Sub  Infra  Red  Exploitation  Device) 
MK~C8 


MK  68 

Impr.  EOSS 
MKB6 

lmpr.  EOSS 


_(/!*«  I  • - 


TARTAR  -  MK  74  Fire  Control 


SPG-51B 

SPG-51C 

SPG-51D 


TERRIER  -  MK  7S  Fire  Control  ’ 


SPG-55A _ )  i  SL.V. 

SPG-55B  C  ^  ^  _ 

SPG-55  "M"  (Digital,  CWATv  Track  Mod.) 


BPDSMS  Fire  Control 


MK  115  CoO.2-; 


NATO  Sea  Sparrow  Fire  Control 


RF  Detection  Syrtems 

WLR-1  ■**>  Mtft  ^  i  5"”*' Js 
WLaHKXET*'  .  - 

-4/wLR-€cyy> 

tyn^inModrTrfJ^^ 

SLR-i2 

SLfi-13 

SLQ-21 


WSQK  ) 
BLR-12 
BLR-13  • 
BRIM  . 
OBSHirtcrRS 
APR-25-«od- 


_  SS£-72_(iricl..P.utboard) 
GlaesiC' Outrigger 
TAG=1S&  •• 

UJlTt-W  MBK7-1 
EO  Detection  Systems 


.  .YANYIS 
WLR-13 

Acoustic  Systems 
Hull  Mounted 


/"fc 


<>“7  -  / 


SOS-23 /Steel  Pome,  TRAMJMP  =L 
SOS-23/SteeI  Dome,  TRAM,-  MIP.  LORA 
SQS-23/Stecl  Dome.  TRAM,  MIP.  LORA,  ^ 
~ggg=257Eub5er  Dome  u  pomes) 
ROQ-fts/kubbcr  Dome  U  domes),  ssT-^  *1 
■SOS-26  CX/RubbcrDome  +  Prairie  Masker; 


SQS-53/Kubber  Dome  +~P F 
SQS-53/steel  Dome -13  «- 
"SOS^SS -<»•;> 

Variable  Depth 

SQS-35->l<^ 

(cont'd) 


Passive  Towed  Arrays 


IBTAS  (Interim  ETA S)  -  L  3  jV — 
ETAS  (Escort  Towed  Array)-* 

SUBMARINE 

Seareh/Track 

•  BQG-2B  _ _ 

BQR-7  -t*3  _ . 

BQS-13^1^  _ _ _ 

•  MPS  Mod  of  BQS-13  (DIMUS)-***1! 

BQQ-5  (DIMUS)  _ 

BQS-14  -« u  i»  ^ _ 

"j-QS-lS 

~BQR-20/STASS 

~Iqh-s(v)/tuba  !-»•>** 

TUBA  I  Upgrade _ 

BQH-4/TUBA  fl 
BSQ-3A  Intrepid 


Classification 
BQQ-3  * 

Intercept 


JWLR_-9.A _ 

W.LR-12. .  t 

BLR-14  (SAWS) 


EXHIBIT  />  (cont'd) 


Command  and  Control  Systems 


Data  Systems 

KTDS  Improved  _ 

D&tacorts  _ 

PPG -TPS  _ . 

Teletype  Data  Integrated  Display  (TIDY)  -  4  ,v 

Adv.  Data  Display  group  -4  1  ^ _ 

Task  Force  Command  Center  - 
/  ■  ■  . -  ■ 

Escort  Command  and  Control  Center  —  4 
Commanding  Officers  TPS  (COTDS)  -  *• 1 V 

SIAC  -  Phase!  ~4  1  v _ 

SIAC -Phase  II  _ 


SIAC -Phase 


trsc^cvfc 

Small  Ship  SHF 


Link  Securit 


NESTOR 
PARR  HILL 
PLATO 
VALLOR 
Digit.  Data 


Navigation  Systems 


MK19  Gyro  _ 

MK.23.  Ovro-^*^ 

MR  27  Gvro  " - 
Adv.  Stabilization  Gyrocompass  (XSGp~cro~t^~ 


0 — fcjJ'V- 


Inertial  Navigation 


S 


uswjjti 

Tszm&wm 


3nras*35i 


Dual  Miniature  Inertial  Nav.  S 


Elec.  Suso.  Gyro  Nav.  (ESGN)  -  us'v- 


JJQNrl,.4~‘2£_ - 

PON-4A  _ 

BQN-17 


AbsoL  Position 

LORAN  C  (SRN,  BRN) 

Omega  (SRN-12.SRN-7)  .  t 

Transit (SRN-9)  \.  UfW 

Stellar  Nav.  \ 

exhibit  D  (cont'd)  NAVSTAR  Global  Positioning  System-y^-  0 


Relative  Posit 


TACAN  -.8RNr€. 
-  URN-SOB 


RDF' 


URDri 
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DEPARTMENT  OF  THE  NAVY 
HEADOUARTERS  NAVAL  MATERIAL  COMMAND 

WASHINGTON.  D.  C  20360  ».  »en.»  ■*»»« 

1  FEB  1580 


From:  Chief  of  Naval  Material 

Subj:  Technology  Transfer  Assessment  Survey 

1.  The  Export  Administration  Act  of  1979  and  OPNAVINST  5510.156  mandate 
that  the  control  of  design  and  manufacturing  know-how,  in  addition  to 
critical  military  end  products  of  technology.  Is  absolutely  vital  to  the 
maintenance  of  U.  S.  technological  superiority.  In  this  regard,  the 
Department  of  Defense  has  been  urged  to  aid  In  maintaining  the  U.  S. 
strategic  technology  lead  by  developing  policy  objectives  and  strategies 
for  the  export  control  of  critical  technologies. 

2.  In  order  to  achieve  this  goal  it  is  essential  that  critical  technologies 
be  systematically  Identified  and  assessed  with  regard  to  the  necessity, 
feasibility,  and  method  of  export  control  to  foreign  countries.  Toward  this 
purpose,  MAT  08D  and  the  NRL  Critical  Technology  Assessment  Office,  under 
my  auspices,  are  conducting  a  TECHNOLOGY  TRANSFER  ASSESSMENT  SURVEY. 

'  3.  •  Your  contribution  to  this  assessment  Is  vital  and  will  be  greatly 
appreciated  as  the  knowledge  and  judgment  of  your  people  Is  the  major 
source  of  data  for  this  study.  As  a  participant  you  will  be  asked  to 
resppnd  to  a  SYSTEMS  IDENTITY  QUESTIONNAIRE  AND  DATA  QUESTIONNAIRE  which 
will  be  provided  to  a  designated  central  point  of  contact  within  each 
command.  It  Is  envisioned  that  these  central  points  of  contact  will 
distribute  the  questionnaire  to  each  Program  Manager  within  their  Command. 

4.  The  data  your  staff  supplies  will  be  computer  analyzed  by  a  pre-tested 
’mathematical  model,  and  the  results  will  be  integrated  by  panels  of 
leading  experts  from  government,  industry,  and  academia.  The  final  out¬ 
come  of  this  process  will  be  a  Navy  computer  supported  data-base,  amenable 
to  updating,  which  lists  specific  critical  technologies,  assesses  optimal 
methods  for  the  control  of  their  exports,  and  provides  a  roster  of  cognizant 
technical  experts. 

5.  Your  support  in  the  successful  completion  of  this  survey  Is  strongly 
encouraged  and  I  request  that  you  designate  your  command  point  of  contact 
to  MAT  08D2  (Mr.  0.  Dunlavey,  692-3127/28)  prior  to  HFebruary  1980. 

EDWARD  J.  07TH./ 

Deputy  Chief -of  Naval 
Material  (Acquisition) 


Distribution: 
(See  page  two) 


DEPARTMENT  OF  THE  NAVY 
NAVAL  ELECTRONIC  SYSTEMS  COMMAND 
WASHINGTON.  D.C.  203 SO 


MEMORANDUM 
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ELEX  09F:ats 
Ser  43/09F 

t  £  FEB  IS 80 


From:  ELEX  09F 
To:  Distribution 

Sub j :  U.S.  Navy  Material  Command  Technology  Transfer 
Assessment  Survey 

Enel:  (1)  Questionnaire 

1.  The  NRL  Critical  Technology  Assessment  Office  under 
the  auspices  of  RADM  Edward  J.  Otth,  Deputy  Chief  of 
Naval  Material  (Acquisition)  is  now  conducting  the 
Technology  Transfer  Assessment  Survey  as  mandated  by 

the  Export  Administration  Act  of  1979  and  OPNAV  Instruction 
5510.156.  The  purpose  of  this  study  is  the  assessment  of 
export  control  and  identification  of  critical  technologies 
(see  enclosure  (1)  for  more  information) . 

2.  You  have  been  identified  by  this  office  as  the  individual 
most  knowledgeable  about  the  subsystem  named  on  the  accomDanving 
route  sheet.  As  such,  you  are  receiving  a  copy  of  the 
Technology  Transfer  Assessment  Questionnaire  (enclosure  (1)) 
with  this  memorandum  asking  you  about  that  subsystem.  If  you 
have  any  questions  about  this  questionnaire  or  assessment, 

do  not  hesitate  to  contact  Mr.  George  Driscoll,  ELEX  09FD1, 
692-3525/84,  who  is  the  designated  ELEX  point  of  contact. 

3.  The  success  of  this  survey  process  hinges  on  your 
expeditious  completion  and  return  of  this  questionnaire 
to  this  office.  The  significance  of  your  contribution 
to  this  assessment  cannot  be  overstated,  and  will  be 
greatly  appreciated . 


U.S.  NAVY  MATERIAL  COMMAND 
TECHNOLOGY  TRANSFER  ASSESSMENT  SURVEY 


telephone  record  sheet 


For  #  on  questionnaire  (ask  Respondent,  appears  on  front  of  ques¬ 
tionnaire  and  on  route  sheet): _ 

Respondent's  question  or  problem: 


Action  (check  one):  a.  answered  question  or  dealt  with  problem^ 

b.  referred  call  to  DATA  SOLUTIONS  _ 

c.  referred  call  to  Les  Winslow  _ 

Response  given  to  respondent  or  action  taken  other  than  referal 
to  DATA  SOLUTIONS  or  to  Les  Winslow: 


CRITICAL  TECHNOLOGY  OFFICE,  NRL: 
(201)  767-2887  Les  Winslow 


Telephone  Sheet 


DRAFT /REVISION  I 


GUIDELINES  FOR 

'  .j.  CRITICAL  TECHNOLOGY  ASSESSMENT  COMMITTEES 

I .  ADMINISTRATION 

A.  Fiscal 

1.  Committees  are  provided  funding  for  their  activities 
by  the  Navy  Material  Command  via  NRL  Code  1404. 

2.  Legitimate  committee  expenditures  include: 

a .  copy ing 

b.  computer  search 

c.  library  information 

d.  long  distance  calls 

e.  travel  arrangements  and  expenses 

f.  time  spent  on  committee  function 

3.  Inquiries  concerning  the  reimbursement  of  academic, 
industry,  and  others  should  be  directed  to  the  CTA 
Office. 


Working  Group  Representative) 


1.  The  Chair  will  select  an  alternate  Chair  to  serve  in 
his  absence. 

2.  The  Chair  will  select  committee  members.  Criteria  for 
selection  includes  balance  of  member  backgrounds,  train¬ 
ing,  and  representation  of  Navy  systems  and  labs 
(uniformed  military  technical  experts  should  be  in¬ 
cluded  where  possible  and  appropriate) ,  industry  and 


1 


academia  representation.  Selection  of  committee 
members  should  be  based  not  only  on  the  breadth  and 
depth  of  their  knowledge  of  the  technologies  involved, 
but  also  on  their  ability  to  identify  specialized 
experts  in  these  areas.  Also,  in  the  case  of  system  : 
or  subsystem  committees.  Chair  should  be  cognizant  of 
subcommittees  in  related  areas  so  as  to  avoid  redundancy 
of  expertise  in  committee  member  selection. 

3.  Committee  size  at  discretion  of  Chair,  but  not  so 
large  a  group  as  to  be  unwieldy  in  terms  of  logistics, 
deliberation,  and  available  resources. 

4.  Committee  members  should  have  security  clearance  on  a 
par  with  the  level  dictated  by  the  technology  areas 
involved . 

5.  Names  of  alternate  committee  members  (in  instances  of 
multiple  nominations)  should  be  held  for  future  con¬ 
sideration  as  "validation  committee"  members. 

C.  Meeting  Logistics 

1.  These  are  informal  goals. 

2 .  Frequency  and  duration  of  meetings  is  dependent  on 
nature  of  task  and  time  frame  of  committee  goals 
and  milestone,  and  this  will  be  determined  by  the 
Chair . 

3.  Matters  formally  submitted  should  not  necessarily 
represent  the  conclusions  of  a  quorum  of  committee 
members  or  alternates  (quorum=ma jority  of  members) . 

A  minority  opinion  is  recommended. 

4.  Meetings  should  be  located  at  office  of  Chair,  or 
at  any  location  which  members  agree  will  facilitate 
useful  discussion.  A  conference  room  is  available 
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in  Room  211  of  Building  33A. 

5.  Chair  has  responsibility  for  obtaining  sufficient 
clerical  personnel  to  adequately  support  the  needs 
of  meetings.  This  may  include  notes,  recordings, 

=■  secretarial  assistance,  meeting  arrangements  and 
notifications,  copying,  and  other  needs  of  this 
sort. 

6.  If  secretarial  services  are  unavailable,  contact 
Shirley  Cohee  (x72887)  for  directions  in  obtaining 
aid. 


D.  Security 


1.  Classified  and  proprietary  information  acquired 

by  committees  and  individual  participants  should  be 
handled  by  established  procedures  within  each  office. 
This  applies  to  hardcopy,  transcripts,  notes,  voice 
recordings,  and  notes  of  conversations.  The  Chair 
of  each  committee  is  expected  to  determine  that 
appropriate  procedures  are  being  followed,  consistent 
with  the  particular  needs  of  that  committee's  efforts. 
Comparable  procedures  for  lending  such  information  to 
others  (other  committees  or  expert  panels  used  in 
evaluating  a  technology)  should  also  follow  estab¬ 
lished  control  processes  to  assure  security  of  the 
information. 

2.  All  formal  queries  coming  from  outside  sources  to 
committees  should  be  directed  to  the  CTA  Office 
(such  as  from  Congressional  staffers,  other  agencies 
within  Navy  committees,  DOD/IDA  Working  Group. 
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Within  each  committee  a  single  point  of  contact 
should  be  appointed  to  receive  these  queries 
through  the  CTA  Office.  This,  in  roost  instances, 
is  likely  to  be  the  Chair. 


II.  INFORMATION  HANDLING 


A.  Inputs  to  Committees 

1.  T2hair  is  responsiole  for  disseminating  to  committee  ; 
members  information  that  is  to  be  provided  from  the 

CTA  Office  (this  includes  the  CoCoM  lists,  the  Navy 
Critical  Technology  Area  List,  the  Critical  Technology 
Assessment  Survey  Results,  and  various  reports  and 
instructions)  and  the  timing  of  availability  of  these 
resources.  For  example,  after  potential  items  list 
(interim  list  of  critical  technologies)  is  submitted, 

CTA  Office  will  send  information  to  ONR  and  NISC  for 
evaluations  of  availability  of  technologies  to  friendly 
foreign  nations  and  potential  adversaries,  respectively, 
and  these  evaluations  will  be  disseminated  to  committees 
in  their  deliberations  regarding  the  "penultimate  list" 
of  critical  technologies. 

2.  Strategies,  formats,  and  timing  for  the  solicitation  of 
inputs  from  experts  to  committees  is  at  the  discretion 
of  the  Chair  and  committee  members.  Inputs  may  be 
solicited  in  the  form  of  independent  analyses  and 
evaluations,  or  in  the  form  of  revised  evaluations/ 
critiques  of  committee  analyses. 

3.  It  is  suggested  that  the  Chair  and  committee  members 
use  the  resources  provided  by  the  CTA  Office  (e.g.  the 
Bucy  Report)  to  establish  a  framework  and  guidelines 
for  their  efforts,  tailoring  the  information  provided 
as  appropriate  to  the  committees'  area  of  concern. 

4.  Chair  and  committee  members  should  be  cognizant  of 
lag  time  between  request  and  delivery  of  information. 
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In  this  regard,  letters  soliciting  points  of  con¬ 
tact  for  expert  involvement  or  directly  to  experts 
should  be  sent  as  early  as  possible  in  the  deliber¬ 
ation  process. 

"5.  Solicitation  of  technical  expert  contribution  for  ? 
technical  information  may  be  from  Navy  System 
Command,  Navy  laboratories,  academia,  industry, 
professional  or  trade  associations.  For  funding 
purposes,  it  is  preferable  that  they  be  currently 
involved  in  serving  in  Navy-related  efforts. 

6.  Appropriate  protocol  should  be  followed  in  solicit¬ 
ing  technical  expert  input;  including  agreement  to 
serve  from  the  individual  and  informing  his  superior 
(which  may  also  involve  a  formal  agreement) . 

Security  clearance  for  the  individual  need  only 

be  to  the  level  appropriate  to  the  technology  area 
of  concern. 

7.  Solicitation  of  agreement  by  an  expert  to  appear 
on  the  "register  of  expert"  list  should  follow 
appropriate  formal  protocol. 

8.  Input  on  task  goals  and  milestones  will  be  provided 
periodically  by  CTA  Office. 

B.  Inter-committee  Interaction/Information  Exchange 

1.  Chairs  should  share  with  other  committee  Chairs  lists 
of  technology  area  domains  determined  by  their  com¬ 
mittees.  Each  committee  should  review  and  assess 
the  relevancy  of  other  committee  domains  to  their 
own.  The  CTA  Office  will  coordinate  these  reviews 
and  determine  where  overlaps  necessitate  either  do¬ 
main  alterations  as  opposed  to  necessary  redundancy. 
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2. 


Committee  members  should  feel  free  to  exchange 
information  to  members  of  other  committees  as 
they  deem  appropriate.  In  this  regard,  all  com¬ 
mittees  should  have  periodically  updated  lists  of 
-  current  committee  membership,  phone  numbers,  and 
schedules.  This  may  be  coordinated  through  the 
CTA  Office. 

3.  Other  committees  should  be  made  aware  of  strategies 
being  followed  for  both  input  to,  and  output  from, 
committee  deliberations. 

4 .  When  information  is  exchanged  between  committee 
Chairs,  an  information  copy  should  be  submitted  to 
the  CTA  Office. 

Outputs  From  Committees 

1.  Copies  of  notices  of  committee  meetings,  and  a 
notation  of  attendees,  should  be  forwarded  to  the 
CTA  Office  after  each  meeting. 

2.  Committees  should  submit  preliminary  lists  of 
critical  technologies  and  register  of  experts  in 
such  a  manner  as  to  make  possible  evaluation  in 
regard  to  completeness  and  utility  by  the  CTA 
Office . 

3.  Each  committee  is  responsible  for  determining 
strategies  for  constructing  preliminary  lists  and 
for  validating  those  lists  subsequent  to  further 
input.  Committees  may  choose,  for  instance,  to 
hold  out  a  list  of  experts  who  will  later  serve 
as  an  independent  review  panel  for  the  validation 
of  the  committees  interim  lists.  Alternately,  use 


may  be  made  of  already  existing  advisory  groups 
to  serve  this  purpose. 

4.  Nominees  for  the  Register  of  Experts  should  be 
transmitted  to  the  CTA  Office. 

-  M 

5.  If  committee  members  hold  conflicting  positions 
concerning  issues  related  to  critical  technology 
assessment/  these  conflicts  should  be  documented 
(perhaps  as  majority  and  minority  positions)  in 

*  output  reports. 

6.  After  the  preliminary  list  of  critical  technologies 
has  been  submitted,  committees  will  receive  the 
results  of  the  Critical  Technology  Assessment  Sur¬ 
vey.  These  results  will  be  in  the  form  of  evaluations 
of  the  criticality  of  Navy  equipments  at  the  system, 
subsystem,  and  device  level.  Output  reports  from 
committees  should  document  the  degree  of  utility 

.......  of  these  results  and  areas  of  agreement  and  disagree¬ 

ment.  The  CTA  Office  will  provide  a  format  for 
these  evaluations,  which  provides  a  means  for  them 
<  to  be  fed  into  the  Navy  critical  technology  database. 

7.  Provision  of  output  information  to  TWGs  should  be 
coordinated  through  the  CTA  Office.  Over  time  the 
CTA  Office  will  provide  guidance  as  to  the  format 
of  output  reports  to  facilitate  ease  of  review, 
output  sharing  with  other  committees  and  integra¬ 
tion  of  output  with  other  souces  (e.g.  the  Critical 
Technology  Assessment  Survey  database) .  One  major 
goal  of  this  process  will  be  to  assist  in  the  evolu- 

,  t  tion  of  a  common  basis  for  categorizing  technologies. 

This  common  basis  would  transcend  all  disciplinary 
boundaries,  and  serve  as  a  foundation  for  future 
assessment  efforts. 


